Power-Law Distributed Graph Generation With MapReduce
نویسندگان
چکیده
A graph generator is a tool which allows to create graph-like data whose structural properties are very similar those found in real world networks. This paper presents two methods generate graphs with power-law edge distribution based on the MapReduce processing model that can be easily implemented run top of Apache Hadoop. The proposed allow generation directed and undirected distributed without repeated edges. Our experimental evaluation shows our efficient scalable terms both size cluster capacity.
منابع مشابه
Distributed Power-law Graph Computing Distributed Power-law Graph Computing: Theoretical and Empirical Analysis∗
Typically, a large-scale natural graph follows a skewed power law. In distributed graphstructured computations, the skewness usually makes a bad partitioning, which leads to high communication cost and workload imbalance. Therefore, graph partitioning (GP) is a challenging issue. To tackle this challenge, we introduce degree-based techniques into GP via vertex-cut. Accordingly, we develop a nov...
متن کاملDistributed Power-law Graph Computing: Theoretical and Empirical Analysis
With the emergence of big graphs in a variety of real applications like social networks, machine learning based on distributed graph-computing (DGC) frameworks has attracted much attention from big data machine learning community. In DGC frameworks, the graph partitioning (GP) strategy plays a key role to affect the performance, including the workload balance and communication cost. Typically, ...
متن کاملPower-Law Graph Cuts
Algorithms based on spectral graph cut objectives such as normalized cuts, ratio cuts and ratio association have become popular in recent years because they are widely applicable and simple to implement via standard eigenvector computations. Despite strong performance for a number of clustering tasks, spectral graph cut algorithms still suffer from several limitations: first, they require the n...
متن کاملEconomic Aspect of Fuel Cell Power as Distributed Generation
This paper presents an energy management strategy to supply residential load by hybrid fuel cell power plant (FCPP). Economical fuel cell (FC) model includes thermal load, local electrical load, operational cost, startup cost and different tariffs on electricity during the day hour is discussed. Several Strategies have been presented for supplying residential load (electrical and thermal loads...
متن کاملDistributed Programming with MapReduce
THIS CHAPTER DESCRIBES THE DESIGN AND IMPLEMENTATION OF MAPREDUCE, a programming system for large-scale data processing problems. MapReduce was developed as a way of simplifying the development of large-scale computations at Google. MapReduce programs are automatically parallelized and executed on a large cluster of commodity machines. The runtime system takes care of the details of partitionin...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2021
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2021.3093329